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TITLE OF THE INVENTION 
Decoder and Decoding Method 

BACKGROUND OF THE INVENTION 
Field of the Invention 

This invention relates to a decoder and a decoding method adapted to 
soft-output decoding. 
Related Background Art 

There have been many studies in recent years for minimizing symbol 
error rates by obtaining soft-outputs for the decoded outputs of inner codes of 
concatenated codes or the outputs of recursive decoding operations using a 
recursive decoding method. There have also been studies for developing 
decoding methods that are adapted to producing soft-outputs. For example, 
Bahl, Cocke, Jelinek and Raviv, "Optimal decoding of linear codes for 
minimizing symbol error rates", IEEE Trans. Inf Theory, vol. It-20, PP. 284- 
287, Mar. 1974 describes an algorithm for minimizing symbol error rates when 
decoding predetermined codes such as convolutional codes. The algorithm will 
be referred to as BCJR algorithm hereinafer. The BCJR algorithm is designed 
to output not each symbol but the likelihood of each symbol as a result of 
decoding operation. Such an outputs is referred to as soft-output. The BCJR 
algorithm will be discussed below firstly by referring to FIG. 1. It is assuemd 
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that digital information is put into convolutional codes by encoder 201 of a 
transmitter (not shown), whose output is then input to a receiver (not shown) 
by way of a memoryless channel 202 having noises and decoded by decoder 
203 of the receiver for observation. 

The M states (transitional states) representing the contents of the shift 
registers of the encoder 201 are denoted by integer m (m = 0, 1, M-1) and 
the state at time t is denoted by S,. If information of k bits is input in a time 
slot, the input at time t is expressed by means of i, = (iti, i^s , i,k) and the 
input system is expressed by means of Ij^ = (ii, 12 , ir)- If there is a 
transition from state m' to state m, the information bits corresponding to the 
transition are expressed by means of i (m', m) = (ii (m', m), ij (m', m), ... , 
(m\ m)). Additionally, if a code of n bits is output in a time slot, the output 
at time t is expressed by means of Xt= (x^i, Xtj , .., x^„) and the output system 
is expressed by means of Xj"^ = (xj, Xj , Xj). If there is a transition from 
state m' to state m, the information bits corresponding to the transition are 
expressed by means of x (m', m) = (xj (m', m), x^ (m', m), ... , x,, (m', m)). 

The encoder 201 starts to produce convolutinal codes at state Sq = 0 and 
ends at state = 0 after outputting X^'^. The inter-state transition probabilities 
Pj (m |m') of the above encoder are defined by formula (1) below; 

PXm\m') = Vr{s, = m\S,_, = wi) ...(1) 



where Pr {A | B} at the right side of the above equation represents the 
conditional probability with which A occurs under the conditions in which B 
occurs. The transition probabilities (m |m') are equal to the probability Pr 
{it = i} that input i^ at time t is equal to i when a transition from state m' to 
state m occurs with input i as shown by formula (2) below. 



The memoryless channel 202 having noises receives as input and 
outputs . If a received value of n bits is output in a time slot, the output at 
time t is expressed by means of yt= (y^i, y,2 , ytk) and the output system is 
expressed by means of = (y^, y2 , y-j). Then, the transition probabilities 
of the memoryless channel 202 having noises can be defined for all values of 
t (1 < t< T) by using the transition probability of each symbol, or Pr {yj jxj }. 



Now, k^j is defined by formula (4) below as the likelihood of input 
information at time t when Yj^ is received, or the soft-output to be obtained. 



pXm\j?^)= Pr{z; - /•} ...(2) 




(4) 
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With the BCJR algorithm, probabilities c:^, and Yt ^^e defined 
respectively by means of formulas (5) through (7) below. Note that Pr {A ; B} 
represents the probability with which both A and B occur. 



Now, the probabilities of a^, Pj and Yt will be described by referring to 
FIG. 2, which is a trellis diagram, or a state transition diagram, of the encoder 
201. Referring to FIG. 2, a^.j corresponds to the passing probability of each 
state at time t-1 as computed on a time series basis from the state of starting 
the coding Sq = 0 by using the received value and p^ corresponds to the passing 
probability of each state at time t as computed on an inverse time series basis 
from the state of ending the coding Sj = 0 by using the received value, while 
Yt corresponds to the reception probability of the output of each branch 
showing a transition from a state to another at time t as computed on the basis 
of the received value and the input probability. 

Then, the soft-output X^j is expressed in terms of the probabilities a^, P^ 
and Yt iri ^ manner as shown in formula (8) below. 



a^{m) = ?Y{s^ = mX} ...(5) 



l3Xm) = Vv{Y^^,\S^ = m} ...(6) 
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...(8) 



Meanwhile, formula (9) below holds true for t= 1,2, T. 



where aj^O) = 1, aoim) = 0{m ^ O) 



...(9) 



Similarly, formula (10) holds true also for t = 1,2, T. 



...(10) 



Finally, formula (1 1) holds true for y^. 



Pf {m\ m')- Fr{yf | x(m' , m)} 

= Pr{/^ = f(m\m)]'Fr{yf\x{m\m)} ^^^^ 



0 :*2 
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: * 1... when a transition occurs from m' to m with input i. 

: *2... when no transition occurs from m' to m with input i. 

Thus, for soft-output decoding, applying the BCJR algorithm, the 
decoder 203 determines the soft-output X^ by passing through the steps shown 
in FIG. 3, utilizing the above relationships. 

More specifically, in Step S201, the decoder 203 computes the 
probabilities a-tim) and Yt n™), using the formulas (9) and (11) above, each 
time it receives y^. 

Then, in Step S202, after receiving all the system Yi^, the decoder 203 
computes the probability Pt (m) of state m for all values of time t, using the 
formula (10) above. 

Thereafter, in Step S203, the decoder 203 computes the soft-output at 
each time t by substituting the values obtained in Steps S201 and S202 for the 
probabilities a^, and Ytin the formula (8) above. 

With the above described processing steps, the decoder 203 can carry out 
the soft-output decoding, applying the BCJR algorithm. 

However, the BCJR algorithm is accompanied by a problem that it 
involves a large volume of computational operations because it requires to 
directly hold probabilities as values to be used for computations and employ 
multiplications. As an attempt for reducing the volume of computational 
operations, Robertson, Villebrun and Hoeher, "A Comparison of Optimal and 



sub-optimal MAP decoding algorithms operating in the domain", IEEE Int. 
Conf. On Communications, pp. 1009-1013, June 1995, proposes Max-Log- 
MAP Algorithm and Log-MAP Algorithm (to be referred to as Max-Log-BCJR 
algorithm and Log-BCJR algorithm respectively hereinafter). 

Firstly, Max-Log-BCJR algorithm will be discussed below. With the 
Max-Log-BCJR algorithm, the probabilities a^, and y, are expressed in terms 
of natural logarithm so that the multiplications for determining the 
probabilities are replaced by a logarithmic addition as expressed by formula 
(12) below and the logarithmic addition is approximated by a logarithmic 
maximizing operation as expressed by formula (13) below. Note that in the 
formula (13), max (x, y) represents a function for selecting either x and y that 
has a larger value. 



For simplification, the natural logarithm is expressed by means of I and 
values cc^, Yt and are expressed respectively by means of la^, iPj, lYt ^^d 
I At in the domain of the natural logarithm as shown in formula (14) below. 



\og{e''e^)= x+ y ...(12) 




Ij3Xm)=\og{/3,{m)) 
IX, = logl, 



With the Max-Log-BCJR algorithm, the log likelihoods Icc^, ip^, lYt are 
approximated by using formulas (15) through (17) below. Note that the 
maximum value max in state m' at the right side of the equation of (15) is 
determined in state m' showing a transition to state m. Similarly, the 
maximum value max in state m' at the right side of the equation of (16) is 
determined in state m' showing a transition to state m. 

laXm) = max(/<ar,_i(wO+ ...(15) 

I/j (w' , m) = log(Pr{/, = i(m' , m)}) + log(Pr {y, | x{m' , m)}) ...(17) 

With the Max-Log-BCJR algorithm, logarithmic soft-output is also 
approximated by using formula (18) below. Note that, in the equation of (18), 
the maximum value max of the first term at the right side is determined in state 
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m' showing a transition to state m when "1" is input and the maximum value 
max of the second term at the right side of the above equation is determined 
in state m' showing a transition to state m when "0" is input. 



Thus, for soft-output decoding, applying the Max-Log-BCJR algorithm, 
the decoder 203 determines soft-output At by passing through the steps shown 
in FIG. 4, utilizing the above relationships. 

More specifically, in Step S211, the decoder 203 computes the log 
likelihoods la^ (m) and lyt (m', m), using the formulas (15) and (17) above, 
each time it receives y^ 

Then, in Step S212, after receiving all the system Y/, the decoder 203 
computes the log likelihood I|3, (m)of state m for all values of time t, using the 
formula (16) above. 

Thereafter, in Step S213, the decoder 203 computes the log soft-output 
lA^ at each time t by substituting the values obtained in Steps S211 and S212 
for the log likelihoods la^, iPt and lyt in the formula (18) above. 

With the above described processing steps, the decoder 203 can carry out 



IA,„. = max 



+ lY,{m\ni) + Ij3,(m)) 
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the soft-output decoding, applying the Max-Log-BCJR algorithm. 

As pointed out above, since the Max-Log-BCJR algorithm does not 
involve any multiplications, it can greatly reduce the volume of computational 
operations if compared with the BCJR algorithm. 

Now, the Log-BCJR algorithm will be discussed below. The Log-BCJR 
algorithm is devised to improve the accuracy of approximation of the Max- 
Log-BCJR algorithm. More specifically, in the Log-BCJR algorithm, a 
correction terra is added to the addition of probabilities of the formula (13) to 
obtain formula (19) below so that the sum of the addition of the formula (19) 
may represent a more accurate logarithmic value. The correction is referred 
to as log-sum correction hereinafter. 

log(e'' + e^)= max{x,_y)+ log(l+ g"'"""^'') ...(19) 

The logarithmic operation of the left side of the equation (19) is referred 
to as log-sum operation and, for the purpose of convenience, the operator of 
a log-sum operation is expressed by means of as shown in formula (20) 
below to follow the numeration system described in S. S. Pietrobon, 
"Implementation and performance of a turbo/MAP decoder. Int. J. Satellite 
Commun., vol. 16, pp. 23-46, Jan-Feb. 1998". Then, the operator of a 
cumulative addition is expressed by means of as shown in formula (21) 

below (although it is expressed by means of "E" in the above paper). 
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x#y= log(e^ + e^') ...(20) 

#Z = ((•••((•^0#-^i>^2)-)#^M-i) -(21) 



By using the operator, the log likelihoods la^ and Ipt and the log soft- 
output Ut can be expressed respectively in a manner as shown in formulas (22) 
through (24) below. Since the log likelihood ly^ is expressed by the formula 
(17) above, it will not be described here any further. 

M-l 

laXm) =#X {lcc,_,{m')^ IyXm\m)) ...(22) 



M-l 

Ij3^(m) -#Y.{lAjm') + Irt,i{m,m')) ...(23) 



m\m 



...(24) 



Note that the cumulative addition of the log-sum operations in state m' 
at the right side of the equation of (22) is determined in state m' showing a 
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transition to state m. Similarly, the cumulative addition of the log-sum 
operations in state m' at the right side of the equation of (23) is determined in 
state m' showing a transition to state m. In the equation of (24), the 
cumulative addition of the log-sum operations at the first term of the right side 
is determined in state m' showing a transition to state m when the input is "1" 
and the cumulative addition of the log-sum operations at the second term of the 
right side is determined in state m' showing a transition to state m when the 
input is "0". 

Thus, for soft-output decoding, applying the Log-BCJR algorithm, the 
decoder 203 determines soft-output by passing through the steps shown in 
FIG. 4, utilizing the above relationships. 

More specifically, in Step S211, the decoder 203 computes the log 
likelihoods Ict^ (m) and ly, (m', m), using the formulas (22) and (17) above, 
each time it receives y^. 

Then, in Step S212, after receiving all the system YJ, the decoder 203 
computes the log likelihood iPt (m) of state m for all values of time t, using the 
formula (23) above. 

Thereafter, in Step S213, the decoder 203 computes the log soft-output 
IX, at each time t by substituting the values obtained in Steps S211 and S212 
for the log likelihoods lat, iPt and lytin the formula (24) above. 

With the above described processing steps, the decoder 203 can carry out 
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the soft-output decoding, applying the Log-BCJR algorithm. Since the 
correction term that is the second term at the right side of the above equation 
of (19) is expressed in a one-dimensional function relative to variable |x - y | , 
the decoder 203 can accurately calculate probabilities when the values of the 
second term are stored in advance in the form of a table in a ROM (Read-Only 
Memory). 

By comparing the Log-BCJR algorithm with the Max-Log-BCJR 
algorithm, it will be seen that, while it entails an increased volume of 
arithmetic operations, it does not involve any multiplications and the output is 
simply the logarithmic value of the soft-output of the BCJR algorithm if the 
quantization error is disregarded. 

Meanwhile, methods that can be used for correcting the above described 
log-sum includes the secondary approximation method of approximating the 
relationship with variable |x - y[by so-called secondary approximation and the 
interval division method of arbitrarily dividing variable jx - y|into intervals 
and assigning predetermined values to the respective intervals in addition to 
the above described method of preparing a table for the values of the 
correction term. These log-sum correction methods are developed by putting 
stress on the performance of the algorithm in terms of accurately determining 
the value of the correction term. However, they are accompanied by certain 
problems including a large circuit configuration and slow processing 
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operations. 

Therefore, studies are being made to develop high speed log-sum 
correction methods. Such methods include the linear approximation method 
of linearly approximating the relationship with variable |x - y] and/or the 
threshold value approximation method of determining values for predetermined 
intervals of variable |x - y [respectively by using predetermined threshold 
values. 

The linear approximation method is designed to approximate function F 
= log {1 + e ' (-|x - yj)} as indicated by curve C in FIG. 5 A by a linear 
function as indicated by straight line L. The straight line L in FIG. 5A is 
expressed by means of equation F = -0.3 (|x - yj) + log 2 and the correction 
term shows a degree of degradation of about 0. IdB. 

On the other hand, the threshold value approximation method is designed 
to approximate function F = log {1 + e ' (-|x - y|)} as indicated by curve C in 
FIG. 5B by a step function as indicated by curve T. The curve T in FIG. 5B 
is expressed in a function that gives log 2 for the interval of 0 < jx - y | < 1 and 
0 for the interval of |x - yj > 1. The correction term shows a degree of 
degradation of about 0.2dB. 

Thus, while various methods have been discussed for the purpose of log- 
sum correction, all of them still have something to be improved. 
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BRIEF SUMMARY OF THE INVENTION 

In view of the above identified circumstances, it is therefore the object 
of the present invention to provide a decoder and a decoding method that can 
perform log-smn corrections by means of linear approximation, putting stress 
on speed, with a reduced circuit dimension without adversely affecting the 
decoding performance of the circuit. 

In an aspect of the invention, the above object is achieved by providing 
a decoder for determining the log likelihood logarithmically expressing the 
probability of passing a given state on the basis of the received value regarded 
as soft-input and decoding the input by using the log likelihood, said decoder 
comprising a linear approximation means for calculating a correction term to 
be added to the log likelihood, the correction term being expressed in a one- 
dimensional function relative to a variable said linear approximation means 
being adapted to compute said correction term using a coefficient representing 
the gradient of said function for multiplying said variable, the coefficient being 
expressed as a power exponent of 2. 

Thus, a decoder according to the invention computes the correction term 
expressed in a one-dimensional function by means of a power exponent of 2. 

In another aspect of the invention, there is provided a decoding method 
for determining the log likelihood logarithmically expressing the probability of 
passing a given state on the basis of the received value regarded as soft-input 
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and decoding the input by using the log hkelihood, said decoding method 
comprising a linear approximation step for calculating a correction term to be 
added to the log likelihood, the correction term being expressed in a one- 
dimensional function relative to a variable, said linear approximation step 
being adapted to compute said correction term using a coefficient representing 
the gradient of said function for multiplying said variable, the coefficient being 
expressed as a pov/er exponent of 2. 

Thus, a decoding method according to the invention is used to compute 
the correction term expressed in a one-dimensional function by means of a 
power exponent of 2. 

As described . above, a decoder for determining the log likelihood 
logarithmically expressing the probability of passing a given state on the basis 
of the received value regarded as soft-input and decoding the input by using 
the log likelihood according to the invention comprises a linear approximation 
means for a calculating a correction term to be added to the log likelihood, the 
correction term being expressed in a one-dimensional function relative to a 
variable, said linear approximation means being adapted to compute said 
correction term using a coefficient representing the gradient of said function 
for multiplying said variable, the coefficient being expressed as a power 
exponent of 2. 

Therefore, a decoder according to the invention computes the correction 



term expressed in a one-dimensional function by means of a power exponent 
of 2. Thus, it can realize a high speed operation without adversely affecting 
the decoding performance of the circuit. 

A decoding method for determining the log likelihood logarithmically 
expressing the probability of passing a given state on the basis of the received 
value regarded as soft-input and decoding the input by using the log likelihood 
according to the invention comprises a linear approximation step for a 
calculating a correction term to be added to the log likelihood, the correction 
term being expressed in a one-dimensional function relative to a variable, said 
linear approximation step being adapted to compute said correction term using 
a coefficient representing the gradient of said function for multiplying said 
variable, the coefficient being expressed as a power exponent of 2. 

Therefore, a decoding method according to the invention is used to 
compute the correction term being expressed in a one-dimensional function by 
means of a power exponent of 2. Thus, it can realize a high speed operation 
without adversely affecting the decoding performance of the circuit. 

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING 
FIG. 1 is a schematic block diagram of a communication model; 
FIG. 2 is a schematic trellis diagram of a conventional encoder, 

illustrating the contents of probabilities CL^, Pt and Yti 
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FIG. 3 is a flow chart illustrating the processing steps of a 
decoder for decoding a soft-output by applying the BCJR algorithm; 

FIG. 4 is a flow chart illustrating the processing steps of a conventional 
decoder for decoding a soft-output by applying the Max-Log-BCJR algorithm; 

FIG. 5A is a graph illustrating a function having a correction term and 
an approximating function using a linear approximation technique; 

FIG. 5B is a graph illustrating a function having a correction term and 
an approximating function using a threshold value approximation technique; 

FIG. 6 is a schematic block diagram of a communication model to which 
a data transmission/reception system comprising an embodiment of the 
invention is applied; 

FIG. 7 is a schematic block diagram of the encoder of the data 
transmission/reception system of FIG. 6; 

FIG. 8 is a schematic illustration of the trellis of the encoder of FIG. 6; 

FIG. 9 is a schematic block diagram of the decoder of the data 
transmission/reception system of FIG. 6; 

FIG. 10 is a schematic block diagram of the I a computation/storage 
circuit of the decoder of FIG. 9, illustrating the circuit configuration; 

FIG. 1 1 is a schematic block diagram of the I a computation circuit of the 
I a computation/storage circuit of FIG. 1 0, illustrating the circuit configuration; 

FIG. 12 is a schematic block diagram of the I p computation/storage 
circuit of the decoder of FIG. 9, illustrating the circuit configuration; 
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FIG. 13 is a schematic block diagram of the ip computation circuit of the 
Ip computation/storage circuit of FIG. 12, illustrating the circuit configuration; 

FIG. 14 is a schematic block diagram of the 
addition/comparison/selection circuit of the la computation circuit or the ip 
computation circuit, illustrating the circuit configuration; 

FIG. 15 is a schematic block diagram of the absolute value computation 
circuit of the addition/comparison/selection circuit of FIG. 14, illustrating the 
circuit configuration; 

FIG. 16 is a graph showing the relationship between a function having 
a correction term and a function that can be used by the linear approximation 
circuit of the addition/comparison/selection circuit of FIG. 14 for linear 
approximation, illustrating the operation of log-sum correction of the circuit. 

FIG. 17 is a schematic block diagram of a linear approximation circuit 
that can be used for the purpose of the invention, illustrating the configuration 
of the circuit for computing the value of the correction term, where the 
coefficient -a of function F = -a | P - Q | + b is expressed by using a power 
exponent of 2; 

FIG. 18 is a schematic block diagram of another linear approximation 
circuit that can be used for the purpose of the invention, illustrating the 
configuration of the circuit for computing the value of the correction term, 
where the coefficients -a and b of function F = -a |P - Q | + b are expressed by 
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using power exponent of 2; and 

FIGS. 19A and 19B are schematic illustrations of the computational 
operation of the linear approximation circuit of FIG. 18. 

DETAILED DESCRIPTION OF THE INVENTION 

Now, the present invention will be described by referring to the views of 
the accompanying drawings that illustrate preferred embodiments of the 
invention. 

FIG. 6 is a schematic block diagram of a communication model to which 
a data transmission/reception system comprising an embodiment of the 
m\ ention is applied. More specifically, the data transmission/reception system 
mcludes a transmission unit (not shown) comprising an encoder 1 for putting 
digital information into convolutional codes, a memoryless communication 
channel 2 having noises and adapted to transmitting the output of the 
transmission unit and a reception unit (not shown) comprising a decoder 3 for 
decoding the convolutional codes from the encoder 1. 

In the data transmission/reception system, the decoder 3 is adapted to 
decode the convolutional codes output from the encoder 1 on the basis of the 
maximum a posteriori probability (to be referred to as MAP hereinafter) 
obtained by using the Max-Log-MAP algorithm or the Log-MAP algorithm (to 
be respectively referred to as the Max-Log-BCJR algorithm or the Log-BCJR 
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algorithm hereinafter) as described in Robertson, Villebrun and Hoeher, "A 
Comparison of Optimal and Sub-Optimal MAP Decoding Algorithms Operating 
in the Log Domain", IEEE Int. Conf. On Communications, pp. 1009-1013, June 
1995. More specifically, it is adapted to determine the log likeHhoods of Ia„ 
iPt and lYt and the log soft-output Ik^ that are logarithmic expressions of 
probabilities a^, and Yt and soft output A^, using the natural logarithm. 

In the following description, the M states (transitional states) 
representing the contents of the shift registers of the encoder 1 are denoted by 
mteger m (m = 0, 1, M-1) and the state at time t is denoted by S^. If 
information of k bits is input in a time slot, the input at time t is expressed by 
means of it= (iti, hi . hk) and the input system is expressed by means of Ij^ 
= (ij, 12 , ix)- If there is a transition from state m' to state , m, the 
information bits corresponding to the transition are expressed by means of i 
(m', m) = (ij (m', m), 12 (m\ m), ... , ij, (m', m)). Additionally, if a code of n 
bits is output in a time slot, the output at time t is expressed by means of Xt = 
(Xti, ^ Xtk) and the output system is expressed by means of Xj'^ = (xj, X2 
, Xx). If there is a transition from state m' to state m, the information bits 
corresponding to the transition are expressed by means of x (m', m) = (xj (m', 
m), Xj (m', m), ... , x„ (m', m)). The memoryless communication channel 2 
receives X^^ as input and outputs Yj. If a received value of n bits is output 
in a time slot, the output at time t is expressed by means of = (y,i, y^2 > ■ 
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yj and the output system is expressed by means of Yi"^ = (yj, ya , yi)- 

As shown in FIG. 7, the encoder 1 typically comprises three exclusive 
OR circuits 11, 13, 15 and a pair of shift registers 12, 14 and is adapted to 
carry out convolutional operations with a constraint length of "3". 

The exclusive OR circuit 11 is adapted to carry out an exclusive OR 
operation, using 1-bit input data i^ and the data fed from the exclusive OR 
circuit 13 and supply the shift register 12 and the exclusive OR circuit 15 with 
the outcome of the operation. 

The shift register 12 keeps on feeding the 1-bit data it holds to the 
exclusive OR circuit 13 and the shift register 14. Then, the shift register 12 
holds the 1-bit data fed from the exclusive OR circuit 11 in synchronism with 
a clock and additionally feeds the 1-bit data to the exclusive OR circuit 13 and 
the shift register 14. 

The exclusive OR circuit 13 is adapted to carry out an exclusive OR 
operation, using the data fed from the shift registers 12, 14, and supply the 
exclusive OR circuit 1 1 with the outcome of the operation. 

The shift register 14 keeps on feeding the 1-bit data it holds to the 
exclusive OR circuits 13, 15. Then, the shift register 14 holds the 1-bit data 
fed from the shift register 12 in synchronism with a clock and additionally 
feeds the 1-bit data to the exclusive OR circuits 13, 15. 

The exclusive OR circuit 15 is adapted to carry out an exclusive OR 
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operation, using the data fed from the exclusive OR circuit 1 1 and the data fed 
from the shift register 14, and then outputs the outcome of the operation as 1- 
bit output data x^2 of 2-bit output data externally. 

Thus, as the encoder 1 having the above described configuration receives 
1-bit input data i^j, it externally outputs the data as 1-bit input data x^ that is 
a systematic component of 2-bit output data Xt without modifying it and carries 
out a recursive convolutional operation on the input data i^l. Then, it outputs 
externally the outcome of the operation as the other 1-bit output data x^j of 2- 
bit output data x^. In short, the encoder 1 performs a recursive systematic 
convolutional operation with a coding ratio of "V2" and outputs externally 
output data x,. 

FIG. 8 illustrates the trellis of the encoder 1. Referring to FIG. 8, each 
path indicated by a broken line shows a case where input data iti is "0" and 
each path indicated by a solid line shows a case where input data i^^ is "1". 
The label applied to each path indicates 2-bit output data x^. The states here 
are such that the contents of the shift register 12 and those of the shift register 
14 are sequentially arranged and the states "00", "10", "01", "11" are denoted 
respectively by state numbers "0", "1", "2", "3". Thus, the number of states 
M of the encoder 1 is four and the trellis has such a structure that there are two 
paths getting to the states in the next time slot from the respective states. In 
the following description, the states corresponding to the above state numbers 
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are denoted respectively by state 0, state 1, state 2, state 3. 

The coded output data of the encoder 1 are then output to the receiver 
by way of the memoryless communication channel 2. 

On the other hand, as shown in FIG. 9, the decoder 3 comprises a 
controller 31 for controlling the various components of the decoder 3, an ly 
computation/storage circuit 32 operating as the first probability computing 
means for computing and storing log likelihood ly as the first log likelihood, 
an la computation/storage circuit 33 operating as the second probability 
computing means for computing and storing log likelihood Ice as the second log 
likelihood, an ip computation/storage circuit 34 operating as the third 
probability computing means for computing and storing log likelihood ip as the 
third log likelihood and a soft-output computation circuit 35 operating as soft- 
output computing means for computing log soft-output lA^. The decoder 3 
estimates the input data i^ of the encoder 1 by determining the log soft-output 
lAt from the received value y^ showing an analog value under the influence of 
the noises generated on the memoryless communication channel 2 and hence 
regarded as soft-output. 

The controller 31 supplies control signals SCy, SCoc and SCp 
respectively to the ly computation/storage circuit 32, the la 
computation/storage circuit 33 and the ip computation/storage circuit 34 to 
control these circuits. 
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The ly computation/storage circuit 32 carries out the operation of 
formula (25) below for each received value under the control of the control 
signal SCy fed from the controller 31, using the received value and a priori 
probability information Pr„ to compute the log likelihood lyt at time t and 
stores the obtained log likelihood. In short, the ly computation/storage circuit 
32 computes the log likelihood ly expressing the probability y in the log 
domain as determined for each received value on the basis of the code output 
pattern and the received value. 



The a priori probability Pr^ is obtained as probability Pr {i^j = 1} that 
each of input data i,!, i^ are equal to "1" or probability Pr {i^^ = 0} that each of 
input data i^j, iti are equal to "0" as indicated by formula (26) below. The a 
priori probability Pr^ can alternatively be obtained as probability Pr {i,! = 1 } 
or probability Pr {i^j = 0} by inputting the natural log value of the log 
likelihood ratio of probability Pr {id = 1} to Pr {i,i = 0}, considering the fact 
that the sum of the probability Pr {i^i = 1} and the probability Pr {i^ = 0} is 
equal to "1". 



IyXm\m} = log(Pr{/, = 7(m',m)})+ \og{?x{y,\x(ir{ ,}7i)^ --(25) 
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The ly computation/storage circuit 32 supplies the log likelihood ly^ it 
stores to the la computation/storage circuit 33, the ip computation/storage 
circuit 34 and the soft-output computation circuit 35. More specifically, the 
Iy computation/storage circuit 32 supplies the log likelihood lyt to the la 
computation/storage circuit 33, the Ip computation/storage circuit 34 and the 
soft-output computation circuit 35 in a sequence good for the processing 
operations of these circuits. In the following description, the log likelihood lyt 
supplied from the Iy computation/storage circuit 32 to the la 
computation/storage circuit 33 is expressed by means of Iy (a), the log 
likelihood ly^ supplied from the Iy computation/storage circuit 32 to the ip 
computation/storage circuit 34 is expressed by means of Iy (pi) , Iy (P2) and 
the log likelihood lyt supplied from the Iy computation/storage circuit 32 to 
soft-output computation circuit 35 is expressed by means of Iy (A). 

The la computation/storage circuit 33 carries out the operation of 
formula (27) below under the control of the control signal SCa fed from the 
controller 31, using the log likelihood Iy (a) fed from the Iy 
computation/storage circuit 32 to compute the log likelihood la^ at time t and 
stores the obtained log likelihood. In the formula (27), operator denotes 
the so-called log-sum operation for the log likelihood of transition from state 
m' to state m with input "0" and the log likelihood of transition from state m" 
to state m with input "1". More specifically, the la computation/storage circuit 
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33 computes the log likelihood la^ at time t by carrying out the operation of 
formula (28). In other words, the la computation/storage circuit 33 computes 
the log likelihood la expressing in the log domain the probability a of 
transition from the coding starting state to each state as determined on a time 
series basis for each received value y,. Then, the la computation/storage 
circuit 33 supplies the log likelihood la, it stores to the soft-output computation 
circuit 35. At this time the la computation/storage circuit 33 supplies the log 
likelihood la, to the soft-output computation circuit 35 in a sequence good for 
the processing operations of the circuit 35. In the following description, the 
log likelihood la, supplied from the la computation/storage circuit 33 to the 
soft-output computation circuit 35 is expressed by means of la (X). 



The Ip computation/storage circuit 34 carries out the operation of 
formula (29) below under the control of the control signal SCp fed from the 
controller 31, using the log likelihoods ly (Pl) and ly (p2) fed from the ly 



...(27) 
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computation/storage circuit 32 to compute the log likelihoods ip, at time t of 
the two systems and stores the obtained log likelihoods. In the formula (29), 
operator denotes the so-called log sum operation for the log likelihood of 
transition from state m' to state m with input "0" and the log likelihood of 
transition from state m" to state m with input "1". More specifically, the Ip 
computation/storage circuit 34 computes the log likelihood ip^ at time t by 
carrying out the operation of formula (30). In other words, the ip 
computation/storage 34 computes the log likelihood ip expressing in the log 
domain the probability P of inverse transition from the coding terminating state 
to each state as determined on a time series basis for each received value y^. 
Then, the ip computation/storage circuit 34 supplies the log likelihood ip, of 
one of the systems out of the log likelihoods ip, it stores to the soft-output 
computation circuit 35. At this time the ip computation/storage circuit 34 
supplies the log likelihood Ipt to the soft-output computation circuit 35 in a 
sequence good for the processing operations of the circuit 35. In the following 
description, the log likelihood Ipt supplied from the Ip computation/storage 
circuit 34 to the soft-output computation circuit 35 is expressed by means of 
IP(A). 

m{m) = {ip,,,{m') + lyA^^m)) ^^^^ 
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ip,(m) = max{jfi,^,{m') + /y„i(m,ra'),//?,«,(m")+ 



The soft-output computation circuit 35 carries out the operation of 
formula (31) below, using the log likelihood ly (A) fed from the ly 
computation/storage circuit 32 and the log likelihood la (A) fed from the la 
computation/storage circuit 33, to compute the log soft-output at time t and 
stores the obtained log soft-outputs. After rearranging the log soft-outputs Uf 
it sores, the soft-output computation circuit 35 outputs them externally. In the 
formula (31), operator "#E" denotes the cumulative addition of the so-called 
log sum operations using the above described operator 

"^^^^ , ...(31) 



The decoder 3 having the above described configuration computes the 
log likelihood ly, (m', m) by means of the ly computation/storage circuit 32 
and also the log likelihood la^ (m) by means of the la computation/storage 
circuit 33 each time it receives as input the soft-input value y^ received by the 
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receiving unit. Upon receiving all the received values y^, the decoder 3 
computes the log likelihood iPt for each state m for all the values of time t by 
means of the ip computation/storage circuit 34. Then, the decoder 3 computes 
the log soft-output Uj for each time t by means of the soft-output computation 
circuit 35, using the obtained log likelihoods la^, Ipt and lyt- In this way, the 
decoder 3 can operate for soft-output decoding by applying the Log-BCJR 
algorithm. 

Now, the decoder 3 operates with a reduced circuit size when computing 
the log likelihoods la^ and ip^ by means of the Ice computation/storage circuit 
33 and the ip computation/storage circuit 34. The la computation/storage 
circuit 33 and the ip computation/storage circuit 34 will be described in greater 
detail hereinafter. 

Firstly, the la computation/storage circuit 33 will be described. As 
shown in FIG. 10, the la computation/storage circuit 33 comprises a selector 
41 for selecting either the computed log likelihoods la or the initial value of 
the log likelihood lao, a register 42 for holding either the computed log 
likelihoods la or the initial value of the log likelihood la, an la computation 
circuit 43 for computing the log likelihood la in each state, RAMs (random 
access memories) 44, 45 for sequentially holding the log likelihoods la of 
different states and a selection circuit 46 for selectively taking out the log 
likelihood la read out from the RAMs 44, 45. 
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The selector 41 selects the initial value of the log likelihood la^ at the 
time of initialization or the log likelihoods Ice fed from the la computation 
circuit 43 at any time except the time of initialization under the control of 
control signal SCa fed from the controller 31. The initialization occurs in the 
time slot immediately before the ly computation/storage circuit 32 starts 
outputting log likelihoods ly (a). If the decoder 3 realizes the time when the 
encoder 1 starts a coding operation, log 1 = 0 is given as initial value Ikq in 
state 0 whereas log 0 = -°° is given as initial value in any other state. If, on the 
other hand, the decoder 3 does not realize the time when the encoder 1 starts 
a coding operation, log (1/M), or log (1/4) in the above instance, is given in all 
states. However, what is essential here is that a same value is given in all 
states so that 0 may alternatively be given in all states. The selector 41 
supplies the initial value Ic£o or the log likelihoods la, whichever it selects, to 
the register 42. 

The register 42 holds the initial value Ikq or the log likelihoods la 
supplied from the selector 41. Then, in the next time slot, the register 42 
supplies the initial value lag or the log likelihoods la it holds to the la 
computation circuit 43 and the RAMs 44, 45. 

Referring now to FIG. 11, the la computation circuit 43 comprises 
addition/comparison/selection circuits, the number of which corresponds to the 
number of states. In the above instance, the la computation circuit 43 
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comprises four addition/comparison/selection circuits 47o, 47}, ^'^3- 

Each of the addition/comparison/selection circuits 47o, 47 1, 472 and 473 
are fed with the log likelihoods lyt [00], lYt [10], lYt [01] and lyt [H] of the 
branches corresponding to the respective outputs "00", "10", "01" and "11" on 
the trellis as computed by the ly computation/storage circuit 32 on the basis 
of the transitions on the trellis and the log likelihoods slot la^.i (0), la^.i (1), la^. 
1 (2), iKt.i (3) in all the sates in the immediately preceding time. Then, each of 
the addition/comparison/selection circuits 47o, 47i, 472 and 473 determines the 
log likelihoods la in the next time slot in state 0, state 1, state 2 and state 3. 

More specifically, the addition/comparison/selection circuits 47o receives 
the log likelihoods ly, [00], ly^ [11] and the log likelihoods (0), la^.i (2) as 
inputs and determines the log likelihood loc^ (0) in state 0. 

Similarly, the addition/comparison/selection circuits 47i receives the log 
likelihoods lyt [II], ly^ [00] and the log likelihoods la^,^ (0), lafi (2) as inputs 
and determines the log likelihood Iwt (1) state 1. 

Then, the addition/comparison/selection circuits 472 receives the log 
likelihoods ly^ [10], ly^ [01] and the log likelihoods la^.i (1), la^.j (3) as inputs 
and determines the log likelihood la^ (2) in state 2. 

Furthermore, the addition/comparison/selection circuits 473 receives the 
log likelihoods ly^ [01], lyt [10] and the log likelihoods Icct.i (1), Ittfi (3) as 
inputs and determines the log likelihood la, (3) in state 3. 

-32- 



In this way, the la computation circuit 43 performs the computation of 
the formula (27) and hence that of the formula (28) above, using the log 
likelihoods ly (a) fed from the ly computation/storage circuit 32 and the initial 
value Itto or the log likelihoods la in the immediately preceding time slot held 
by the register 42, to determine the log likelihoods la in all states in the next 
time slot. Then, the la computation circuit 43 suppHes the computed log 
likelihoods la to the selector 41. The addition/comparison/selection circuits 
47^^ 47 47^ and 473 will be described in greater detail hereinafter. 

The RAMs 44, 45 sequentially stores the log likelihoods la (0), la (1), 
la (2) and la (3) fed from the register 42 under the control of the control signal 
SGa from the controller 31. If each of the log likelihoods la (0), la (1), la (2) 
and la (3) is expressed in 8 bits, the RAMs 44, 45 stores the log likelihoods 
la (0), la (1), la (2) and la (3) as a word of 32 bits. The log likelihoods la 
(0), la (1), la (2) and la (3) stored in the RAMs 44, 45 are then read out 
therefrom by selection circuit 46 in a predetermined sequence. 

The selection circuit 46 selectively takes out the log likelihoods la (0), 
la (1), la (2) or la (3) that are read from the RAMs 44, 45 and supplies it to 
the soft-output computation circuit 35 as log likelihood la (X) under the control 
of the control signal SCa from the controller 3 1 . 

Thus, the la computation/storage circuit 33 initializes in a time slot 
immediately before the ly computation/storage circuit 32 starts outputting log 
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likelihoods ly (a) and causes the register 42 to hold the initial value Iccq 
selected by the selector 41. Then, in the subsequent clock cycles, the la 
computation/storage circuit 33 causes the la computation circuit 43 to 
sequentially compute the log likelihoods la in the next time slot, using the log 
likelihoods ly (a) fed from the ly computation/storage circuit 32 and the log 
likelihoods la in the immediately preceding time slot fed from the register 42, 
and makes the register 42 store the log likelihoods la. Furthermore, the la 
computation/storage 33 causes the RAMs 44, 45 to sequentially store the log 
likelihoods la (0), la (1), la (2) and la (3) in the respective states held in the 
register 42 and makes the selection circuit 46 to read them out in a 
predetermined sequence and supply them to the soft-output computation circuit 
35 as log likelihoods la (A). 

Now, the Ip computation/storage circuit 34 will be described. As shown 
in FIG. 12, the Ip computation/storage circuit 34 comprises ip computation 
circuits Slj, 5I2 for computing the log likelihoods Ip in the states, selectors 
52i, 522 for selecting either the computed log likelihoods ip or the initial values 
of the log likelihoods ipa, ipb, registers 53 j, 532 for holding the initial values 
Ipa, Ipb or the log likelihoods ip and a selection circuit 54 for selectively 
taking out one of the log likelihoods fed from the registers 53 j, 532- 

Referring now to FIG. 13, each of the Ip computation circuits 51i, 5I2 
comprises addition/comparison/selection circuits, the number of which 
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corresponds to the number of states. In the above instance, each of the Ip 
computation circuits 51i, 5I2 comprises four addition/comparison/selection 
circuits SSq, 55i, SSj and 55^. 

Each of the addition/comparison/selection circuits 55o, 55i, and 553 
are fed with the log likehhoods lyt [00], lyt [10], ly, [01], ly, [H] of the 
branches corresponding to the respective outputs "00", "10", "01", "11" on the 
trellis as computed on the basis of the transitions on the trellis by the ly 
computation/storage circuit 32 and the log likelihoods Ipt (0), Ip^ (1), iPt (2) 
and iPt (3) in all the sates in the immediately preceding time slot . Then, each 
of the addition/comparison/selection circuits 55o, 55i, 552 and 553 determines 
the log likelihoods ip in the immediately preceding time slot in state 0, state 
1, state 2 and state 3. 

More specifically, the addition/comparison/selection circuits 55oreceives 
the log likelihoods lyt [00], ly^ [11] and the log likelihoods iPt (0), Ipt (1) as 
inputs and determines the log likelihood iPt.j (0) in state 0. 

Similarly, the addition/comparison/selection circuits 55 1 receives the log 
likelihoods ly^ [10], ly, [01] and the log likelihoods Ipt (2), ip, (3) as inputs and 
determines the log likelihood Ip^.i (1) in state 1. 

Then, the addition/comparison/selection circuits receives the log 
likelihoods ly^ [11], lyt [00] and the log likelihoods Ipt (0), Ip, (1) as inputs and 
determines the log likelihood Ipt.i (2) in state 2. 
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Furthermore, the addition/comparison/selection circuits SSg receives the 
log likelihoods lyt [01], ly, [10] and the log likelihoods ip, (2), ip^ (3) as inputs 
and determines the log likelihood Ipt-i (3) in state 3. 

In this way, each of the ip computation circuits 51^, 5I2 performs the 
computation of the formula (29) and hence that of the formula (30) above, 
using the log likelihoods ly (Pl), ly (P2) fed from the ly computation/storage 
circuit 32 and the initial values ipa, Ipb or the log likelihoods Ip held by the 
registers 53 1, 532, to determine the log likelihoods Ip in all states in the 
immediately preceding time slot. Each of the log likelihoods ip (0), Ip (1), ip 
(2), ip (3) is expressed typically by 8 bits to make the total number of bits 
equal to 32. The Ip computation circuits 51i, 5I2 respectively supply the 
computed log likelihoods ip to the selectors 52i, 522. The 
addition/comparison/selection circuits 55o, 55i, 552 and 55, will be described 
in greater detail hereinafter. 

Each of the selectors 52 1, 522 selects the initial value of the log 
likelihood Ipa or Ipb, whichever appropriate, at the time of initialization or the 
log likelihoods ip fed from the Ip computation circuit 51iOr 5I2, whichever 
appropriate, at any time except the time of initialization under the control of 
control signal SCP fed from the controller 31. The initialization occurs in the 
time slot immediately before the ly computation/storage circuit 32 starts 
outputting log likelihoods ly (pi), ly (p2) and repeated in every cycle 
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thereafter that is twice as long as the terminating length. While a same value 
such as 0 or log (1/M), or log (1/4) in this instance, is normally given as initial 
values I(3a, Ipb for all the states, log 1 = 0 is given as the value in the 
concluding state whereas log 0 = is given in any other state when a 
concluded code is decoded. The selectors 52^, supplies respectively either 
the initial values Ipa, Ipb or the log likelihoods ip they select to the respective 
registers SSj, 532- 

The registers 53i, hold the initial values ipa, Ipb or the log 
likelihoods ip supplied from the selectors 52j, 522- Then, in the next time slot, 
the registers 53 j, 532 supply the initial values ipa, ipb or the log likelihoods Ip 
they hold to the ip computation circuits 51j, Slj and the selection circuit 54. 

The selection circuit 54 selectively takes out the log likelihoods ip (0), 
Ip (I), ip (2) or Ip (3) that are supplied from the registers 53i, 532 and supplies 
it to the soft-output computation circuit 35 as log likelihood Ip (X) under the 
control of the control signal SCp from the controller 31. 

Thus, the Ip computation/storage circuit 34 initializes in a time slot 
immediately before the ly computation/storage circuit 32 starts outputting log 
likelihoods ly (pi) and in the subsequently cycle periods having a length twice 
as long as the terminating length and causes the register 53 j to hold the initial 
value ipa selected by the selector 52 j. Then, in the subsequent clock cycles, 
the ip computation/storage circuit 34 causes the ip computation circuit 51; to 
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sequentially compute the log likelihoods Ip in the immediately preceding time 
slot, using the log likelihoods ly (pi) fed from the ly computation/storage 
circuit 32 and the log likelihoods Ip fed from the register 52^, and makes the 
register 53i store the log likelihoods ip. 

Furthermore, the ip computation/storage circuit 34 initializes in a time 
slot immediately before the ly computation/storage circuit 32 starts outputting 
log likelihoods ly (p2) and in the subsequently cycle periods having a length 
twice as long as the terminating length and causes the register 532 to hold the 
initial value Ipb selected by the selector 522- Then, in the subsequent clock 
cycles, the ip computation/storage circuit 34 causes the ip computation circuit 
5 12 to sequentially compute the log likelihoods ip in the immediately preceding 
time slot, using the log likelihoods ly (P2) fed from the ly computation/storage 
circuit 32 and the log likelihoods ip fed from the register 522, and makes the 
register 532 store the log likelihoods ip. Then, the ip computation/storage 
circuit 34 causes the selection circuit 54 to read out the log likelihoods Ip (0), 
IP (1), ip (2) and ip (3) in the respective states held in the registers 53i, 532 in 
a predetermined sequence and supply them to the soft-output computation 
circuit 35 as log likelihoods ip (A). 

Now, the addition/comparison/selection circuits 47o, 47^, Al^ and 473 that 
the la computation/storage circuit 33 comprises and the 
addition/comparison/selection circuits 55o, 55i, SSj and 55^ that the Ip 
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computation/storage circuit 34 comprises will be described below. However, 
since the addition/comparison/selection circuits 47^, Al ^, AI2, 47^, 55q, 55^, 
and 553 have a same and identical configuration and only differ from each 
other in term of inputs they receive and outputs they send out. Therefore, in 
the following description, they will be collectively referred to as 
addition/comparison/selection circuit 60. Furthermore, in the following 
description, the two log likelihoods ly input to each of the four 
addition/comparison/selection circuits 47 q, 47^, and 473 and the two log 
likelihoods ly input to each of the four addition/comparison/selection circuits 
55o, 55i, 552 and 553 are denoted respectively and collectively by lA and IB, 
whereas the two log likelihoods la input to each of the four 
addition/comparison/selection circuits 47o, 47i, 472 and 473. and the two log 
likelihoods ip input to each of the four addition/comparison/selection circuits 
55o, 5 5 1, and 55^ are denoted respectively and collectively by IC and ID. 
Furthermore, the log likelihoods Ice output from each of the 
addition/comparison/selection circuits 47o, 47i, 472 and 473 and the log 
likelihoods Ip output from each of the addition/comparison/selection circuits 
55o, 55i, 552 and 553 are collectively denoted by IE. In the following 
description, any probability is expressed by means of a value not smaller than 
0 and a lower probability is expressed by means of a larger value by taking 
situations where a decoder according to the invention is assembled as 
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hardware. 

As shown in FIG. 14, the addition/comparison/selection circuit 60 
comprises adders 61, 62 for adding two data, comparator circuits 63 for 
comparing the outputs of the adders 61, 62 in terms of size, a selector 64 for 
selecting either one of the outputs of the adders 61, 62, a correction term 
computation circuit 65 for computing the value correction term of the Log- 
BCJR algorithm and a differentiators 66 for obtaining the difference of the two 
data. 

The adder 61 is adapted to receive and add the log likelihoods lA, IC. 
If the addition/comparison/selection circuit 60 is the 
addition/comparison/selection circuit 47o, the adder 61 receives the log 
likelihood I^t [00] and the log likelihood laj.i (0) as input and adds the log 
likelihood lYt [00] and the log likelihood la^.i (0). The adder 61 then supplies 
the data obtained by the addition to the comparator circuit 63, the selector 64 
aad the correction term computation circuit 65. Note that, in the following 
description, the data output from the adder 61 is denoted by P. 

The adder 62 is adapted to receive and add the log likelihoods IB, ID. 
If the addition/comparison/selection circuit 60 is the 
addition/comparison/selection circuit 47^, the adder 62 receives the log 
likelihood ly, [H] and the log likelihood Ia,.i (2) as input and adds the log 
likelihood Ivt [H] and the log likelihood la^.i (2). The adder 62 then supplies 
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the data obtained by the addition to the comparator circuit 63, the selector 64 
and the correction term computation circuit 65. Note that, in the following 
description, the data output from the adder 62 is denoted by Q. 

The comparator circuit 63 compares the value of the data P fed from the 
adder 61 and the value of the data Q fed from the adder 62 to see which is 
larger. Then, the comparator circuit 63 supplies the information on the 
comparison indicating the outcome of the comparison to the selector 64. 

The selector 64 selects either the data P fed from the adder 61 or the 
data Q fed from the adder 62, whichever having a smaller value and hence 
showing a higher probability, on the basis of the information on the comparison 
supplied from the comparator circuit 63. Then, the selector 64 supplies the 
selected, data to the differentiator 66. It will be appreciated that the data 
selected by the selector 64 is same and identical with the first term of the right 
side of the equation (28) and that of the equation (30) shown above. 

The correction term computation circuit 65 comprises an absolute value 
computation circuit 67 for computing the absolute value of difference of the 
data P fed from the adder 61 and the data Q fed from the adder 62 and a linear 
approximation circuit 68 that operates as linear approximation means for 
computing the correction term by linear approximation, using the absolute 
value computed by the absolute value computation circuit 67. The correction 
term computation circuit 65 computes the value of the correction term of the 
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Log-BCJR algorithm or the value of the second term of the right side of the 
equation (28) or the equation (30) shown above. More specifically, the 
correction term computation circuit 65 expresses the correction term as a one- 
dimensional function of variable |P - Q|and computes the linearly 
approximated value in the form of -a | P - Q | + b that uses coefficient -a (a > 
0) indicating the gradient of the function and coefficient b indicating the 
intercept of the function. Then, the correction term computation circuit 65 
supplies the data Z obtained by the computation to the differentiator 66. 

The differentiator 66 determines the difference of the data selected by 
the selector 64 and the data Z fed from the correction term computation circuit 
65 and outputs the difference as log likelihood IE. For instance, if the 
addition/comparison/selection 60 is the addition/comparison/selection circuit 
47o, the differentiator 66 outputs the log likelihood la^ (0). 

Now, the estimation of the delay at the addition/comparison/selection 
circuit 60 will be discussed below. It is assumed here that the delay of a 
comparator circuit and that of a differentiator are same as that of an ordinary 
adder such as the adder 61 or 62. 

As clear from FIG. 14, the delay that is inevitable with the 
addition/comparison/selection 60 includes the delay due to the adders 61, 62 
which can be regarded as a single adder, the delay due to the comparator 
circuit 63 and the delay due to the differentiator 66. In other words, the 
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addition/comparison/selection 60 involves the delay of at least three adders. 

Therefore, in order to minimize the delay of the 
addition/comparison/selection 60, it is necessary to minimize the delay due to 
the correction term computation circuit 65. Therefore, the delay due to the 
correction term computation circuit 65 will be estimated. 

Firstly, the delay of the absolute value computation circuit 67 will be 
estimated. As shown in FIG. 15, the absolute value computation circuit 67 is 
so regarded as to comprise a comparator 71 for comparting the two values 
output from the upstream two adders 61, 62 to see which is larger, a pair of 
differentiators 72, 73 for determining the difference of the two data and a 
selector 74 for selecting one of the outputs of the differentiators 72, 73. 

More specifically, the absolute value computation circuit 67 compares 
the data P fed from the adder 61 and the data Q fed from the adder 62 by 
means of the comparator circuit 71. At the same time, the absolute value 
computation circuit 67 determines the difference (P - Q) of the data P and the 
data Q by means of the differentiator 72 and also the difference (Q - P) of the 
data Q fed from the adder 62 and the data P fed from the adder 61 by means 
of the differentiator 73. Then, the absolute value computation circuit 67 
selects either the difference (P - Q) or the difference (Q - P), whichever 
showing a positive value, by means of the selector 74 on the basis of the 
information on the outcome of the comparison of the comparator circuit 71 and 
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supplies the selected positive value of either the difference (P - Q) or the 
difference (Q - P) to the linear approximation circuit 68 as absolute value data 
iP-QI- 

Thus, as the processing operation of the comparator circuit 71 and that 
of the differentiators 72, 73 are performed concurrently in the absolute value 
computation circuit 67, the absolute value computation circuit 67 involves the 
delay due to an adder and the delay due to a selector. 

As shown in FIG. 16, the linear approximation circuit 68 performs a log- 
sum correction by means of so-called linear approximation so as to 
approximate the function F = -a | P - Q | + b indicated by straight lines Lj , 
to the function F = log {1 + e (-jP - Q|)} indicated by curve C and computes 
the value of the correction term. More specifically, the linear approximation 
circuit 68 computes the value of the correction term at least by expressing the 
coefficient -a of function F = -a |P - Q| + b, using a power exponent of 2. 
Referring to FIG. 16, -a that is expressed by means of a power exponent of 2 
may be -a = -2'^ = -0.5 as indicated by straight line Lj or -a = -2'^ = -0.25 as 
indicated by straight line L2. It is assumed here that -a = -0.25. Then, as 
shown in FIG. 17, the linear approximation circuit 68 is so regarded as to 
comprise a differentiator 81, a comparator circuit 82 and a selector 83. 

The differentiator 81 computes the difference of the coefficient b 
representing the intercept of the function F = -a IP - Q| + b and the upper n-2 
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bits of the n-bit absolute value data |P - Q| fed from the absolute value 
computation circuit 67 and supplies the selector 83 with the difference. 

The computation 82 compares the value of the coefficient b and that of 
data iP - Ql [n : 3] expressed by means of the upper n-2 bits of the absolute 
value data |P - Q| to see which is larger and suppHes the selector 83 with 
information on the outcome of the comparison. 

The selector 83 selects either the data fed from the differentiator 81 or 
"0" on the basis of the information on the outcome of the comparison coming 
from the comparator circuit 82. More specifically, the selector 83 selects the 
data fed from the differentiator 8 1 when the outcome of the comparison of the 
comparator circuit 82 proves |P - Qi [n : 3] < b, whereas it selects "0" when 
|P - Ql [n : 3] > b. Then, the selector 83 supplies the selected data to the 
differentiator 66 as data Z indicating the value of the correction term. 

The linear approximation circuit 68 discards the lowest bit and the 
second lowest bit of the n-bit absolute value data | P - Q 1 fed from the absolute 
value computation circuit 67 and subtracts the data expressed by the remaining 
upper n-2 bits from the coefficient b. In other words, the linear approximation 
circuit 68 can multiply jP - Q| by 1/4 = 0.25 by discarding the two lowest bits 
and bit-shifting the absolute value data |P - Q| and carry out the operation of 
-0.25 |P - Ql + b by subtracting the data expressed by the remaining upper n-2 
bits from the coefficient b. 
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Since the correction term shows a positive value, the linear 
approximation circuit 68 outputs "0" by means of the selector 83 and avoids 
the situation where the correction term takes a negative value if the comparator 
circuit 82 finds out as a result of the comparison that the differentiator 81 
outputs a negative value and hence the value of the correction term is 
computed as negative. 

If -a = -2"' = -0.5 is taken, the linear approximation circuit 68 discards 
the lowest bit of the absolute value data |P - Ql for bit-shifting. Therefore, an 
appropriate number of lower bits of the absolute value data | P - Q | will be 
discarded depending on the power exponent to be used for expressing the 
coefficient -a. 

Thus,, the linear approximation circuit 68 does not require the use of any 
multiplier and involves only a processing operation of the differentiator 81 and 
that of the comparator circuit 82 that proceed concurrently. Therefore, the 
delay of the linear approximation circuit 68 can be estimated as that of a single 
adder and that of a single selector. 

The linear approximation circuit 68 may compute the value of the 
correction term also by using a power exponent of 2 to express the coefficient 
b. If the coefficient b is expressed by means of 2"" - 1 and -a = -0.25, the 
linear approximation circuit 68 can be so regarded as to comprise an inverter 
91, an OR gate 92 and a selector 93 as shown in FIG. 18. 
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The inverter 91 inverts the m bits from the third lowest bit to the m+2-th 
lowest bit of the n-bit absolute value data jP -Q| fed from the absolute value 
computation circuit 67. Then, the inverter 91 supplies the data obtained as a 
result of the inversion to the selector 93. 

The OR gate 92 determines the exclusive OR of the upper n-m-2 bits 
from the m+3-th lowest bit to the n-th lowest bit of the n-bit absolute value 
data IP - Ql fed from the absolute value computation circuit 67. Then, the OR 
gate 92 supplies the obtained exclusive OR to the selector 93. 

The selector 93 selects either the data fed from the inverter 91 or "0" on 
the basis of the exclusive OR fed from the OR gate 92. More specifically, the 
selector 93 selects the data fed from the inverter 91 when the exclusive OR fed 
from the OR gate 92 is equal to "0" but it selects "0" when the exclusive OR 
fed from the OR gate 92 is equal to "1". Then, the selector 93 supplies the 
selected data to the differentiator 66 as data Z indicating the correction term. 

Thus, the linear approximation circuit 68 discards the lowest bit and the 
second lowest bit of the n-bit absolute value data |P - Q | fed from the absolute 
value computation circuit 67 and inverts the m bits from the third lowest bit to 
the m+2-th lowest bit of the remaining upper n-2 bits by means of the inverter 
91. At the same time, the linear approximation circuit 68 determines the 
exclusive OR of the n-m-2 bits from the m+3-th lowest bit to the n-th bit by 
means of the OR gate 92. 
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In other words, the linear approximation circuit 68 can multiply |P - Q| 
by 1/4 = 0.25 by discarding the two lowest bits and bit-shifting the absolute 
value data |P - Ql • Therefore, the linear approximation circuit 68 only needs 
to multiply the data |P - Qi [n : 3] expressed by means of the upper n-2 bits 
of the absolute value data |P - Q|, or 0.25 |P - Q|, by -1 and adds the 
coefficient b that is expressed by means of 2"" - 1 to the product. 

In order to express the arithmetic operations of the linear approximation 
circuit 68 by modus, 0.25 jP - Ql obtained by discarding the two lowest bits 
of the n-bit absolute value data jP - Q| is denoted by A = (A„, A„.i, A^+3, 
A,^+2, ••■.A3) and the m bits from the third lowest bit to the m+2-th lowest bit 
and the n-m-2 bits from the m+3-th lowest bit to the n-th bit of the remaining 
upper n-2 bits are denoted respectively by A' and A" as shown in FIG. 19 A. 

Firstly, it is assumed that "-0.25 |P - Q| + 2" - 1 = -A + (2"^ - 1)" to be 
obtained by the linear approximation circuit 100 shows a negative value. Then, 
the equivalence relation as expressed by formula (32) below holds true. More 
specifically. A" shows a positive value when "-A + {la"" - 1)" shows a negative 
value. In other words, the exclusive OR of all the bits of A" is equal to "1" 
when "-A + (2™ - 1)" shows a negative value. 

-^ + (2'"-l)<0<» ^>2'"-l ^22) 
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Now, it is assumed that "-0.25 ] P - Q | + 2" - 1 - -A + (2'" - 1)" to be 
obtained by the linear approximation circuit 68 shows a value not smaller than 
0. Then, A" = 0 from the equivalence relation expressed by the above formula 
(32) and hence formula (33) below holds true. 

-^+(2™-l)= -^'+(2"'-l) ...(33) 

From the fact that 2""^ - 1 refers to a data where all the m bits are equal 
to "1", "-A + (2"" - 1)" is expressed by means of the negation of A' as shown 
in FIG. 19B. 

Form the above discussion, it will be seen that the linear approximation 
circuit 68 only needs to obtain the negation of the lower m bits of A. 
Therefore, the linear approximation circuit 68 can carry out the operation of 
"-0 25 |P - Ql + 2"" - 1" simply by inverting the data |P - Q| [m + 2 : 2] 
expressed by means of the m bits from the third lowest bit to the m+2-th 
lowest bit out of the absolute value data |P - Q| by means of the inverter 91. 

Additionally, the linear approximation circuit 68 can see if "-0.25 |P - 
Q I + 2™ - 1 " has a positive value or a negative value by obtaining the exclusive 
OR of the data |P - Q| [m + 3 : n] expressed by the n-m-2 bits from the m+3-th 
lowest bit to the n-th bit out of the absolute value data |P - Q|. Therefore, 
since the correction term shows a positive value, the linear approximation 
circuit 68 can avoid any situation where the correction term shows a negative 
value by causing the selector 93 to output "0" when the exclusive OR obtained 
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by the OR gate 92 is "1" and hence the correction term is regarded to show a 
negative value as a result of computation. 

If the coefficient a is expressed by means of -T^, the linear 
approximation circuit 68 discards the bits from the lowest bit to the k-th lowest 
bit of the absolute value data |P - Q| for bit-shifting and inverting the m bits 
from the k+l-th lowest bit to the m+k-th lowest bit. For example, if n = 5 and 
m = 2 so that the operation of "-0.25 |P - Q| + 3" is carried out, the absolute 
value data 1 P - Q | and the data Z will show the relationship as shown in Table 
1 below. Note that Table 1 below additionally shows the above described 
negation of A', or the data output from the inverter 91. 
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Table 1 

Relationship between Absolute Value Data |P - Q| and Data Z 
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As shown in Table 1 above, the linear approximation circuit 68 outputs 
as data Z the data obtained by inverting the data |P - Q| [4 : 2] as expressed 
by 2 bits from the third lowest bit to the fourth (2 + 2 = 4) lowest bit out of the 
absolute value data |P - Q| by means of the inverter 91 for the range of the 
absolute value data |P - Q| between 0 and 12, whereas it outputs "0" for the 
range of the absolute value data jP - Q| not smaller than 13 because the 
output of the inverter 91 is negative in the latter range. 

Thus, the linear approximation circuit 98 can operate with bit-shifts and 
an inverter without requiring the use of a multiplier and an adder so that it can 
be estimated to show the delay of a selector. 
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Therefore, the delay of the correction term computation circuits 65 is 
estimated to be equal to that of two adders and two selectors when the 
correction term computation circuit 68 is made to have the configuration as 
shown in FIG. 17, whereas the delay of the correction term computation circuit 
65 is estimated to be equal to that of an adder and two selectors when the 
circuits are made to have the configuration of FIG. 18. 

Thus, in view of the fact that the processing operation of the comparator 
circuit 63 and that of the absolute value computation circuit 67 are carried out 
concurrently, the delay of the addition/comparison/selection circuit 60 is 
estimated to be equal to that of four adders and three selectors when the linear 
approximation circuit 68 is made to show the configuration of FIG. 17 and to 
that of three adders and three selectors when the linear approximation circuit 
68 is made to show the configuration of FIG. 18. In other words, while the 
addition/comparison/selection 60 originally involves the delay of three adders. 
It can determined the log likelihood IE practically without being affected by the 
delay of the correction term computation circuit 65. 

As described above, a data transmission/reception system comprising an 
encoder I and a decoder 3 can be made to operate quickly without sacrificing 
the performance because the decoder 3 can quickly determine the correction 
term when doing a log-sum correction by means of linear approximation. 

Thus, such a data transmission/reception system comprising an encoder 
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1 and a decoder 3 can decode convolutional codes highly effectively at high 
speed to provide the user with an enhanced level of reliability and convenience. 

The present invention is by no means limited to the above described 
embodiment. For instance, the encoder may not be adapted to convolutional 
operations so long as it operates for coding with an appropriately selected 
cording ratio. 

Additionally, the present invention is applicable to any arrangement for 
decoding codes formed by concatenating a plurality element codes such as 
parallel concatenated convolutional codes, series concatenated convolutional 
codes, codes of a Turbo-coding modulation system or codes of a series 
concatenated coding modulation system. 

While the encoder and the decoder of the above described embodiment 
are applied respectively to the transmitter and the receiver of a data 
transmission/reception system, the present invention can also be applied to a 
recording and/or reproduction device adapted to recording data to and/or 
reproducing data from a recording medium such as a magnetic, optical or 
magneto-optical disc, which may be a floppy disc, a CD-ROM or a MO 
(magneto-optical) disc. Then, the data encoded by the encoder are recorded 
on a recording medium that is equivalent to a memoryless communication 
channel and then decoded and reproduced by the decoder. 

Thus, the above described embodiment can be modified and/or altered 
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